Nonparametric estimating equations based on a penalized information criterion
نویسنده
چکیده
It has recently been observed that, given the mean-variance relation, one can improve on the accuracy of the quasi-likelihood estimator by the adaptive estimator based on the estimation of the higher moments. The estimation of such moments is usually unstable, however, and consequently only for large samples does the improvement become evident. The author proposes a nonparametric estimating equation that does not depend on the estimation such moments, but instead on the penalized minimization of asymptotic variance. His method provides a strong improvement over the quasi-likelihood estimator and the adaptive estimators, for a wide range of sample sizes.
منابع مشابه
Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Generalized Residuals
This paper studies nonparametric estimation of conditional moment models in which the generalized residual functions can be nonsmooth in the unknown functions of endogenous variables. This is a nonparametric nonlinear instrumental variables (IV) problem. We propose a class of penalized sieve minimum distance (PSMD) estimators which are minimizers of a penalized empirical minimum distance criter...
متن کاملEstimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Generalized Residuals By
1 This paper studies nonparametric estimation of conditional moment restrictions in which the generalized residual functions can be nonsmooth in the unknown functions of endogenous variables. This is a nonparametric nonlinear instrumental variables (IV) problem. We propose a class of penalized sieve minimum distance (PSMD) estima-tors, which are minimizers of a penalized empirical minimum dista...
متن کاملLearning nonparametric differential equations with operator-valued kernels and gradient matching
Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general framework for nonparametric ODE models using penalized regression in Reproducing Kernel Hilbert Spaces (RKHS) based on operator-valued kernels. Moreover, we extend...
متن کاملEstimating the Number of Components in a Mixture of Multilayer Perceptrons
BIC criterion is widely used by the neural-network community for model selection tasks, although its convergence properties are not always theoretically established. In this paper we will focus on estimating the number of components in a mixture of multilayer perceptrons and proving the convergence of the BIC criterion in this frame. The penalized marginal-likelihood for mixture models and hidd...
متن کاملEstimation of B-spline Nonparametric Regression Models using Information Criteria
Nonparametric regression modelling has received considerable attention and many methods have been proposed to draw information from data with complex structure. We consider the use of B-spline nonparametric regression models estimated by penalized likelihood methods. A crucial point in constructing the models is in the choice of a smoothing parameter and the number of knots, for which several a...
متن کامل